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Description 

Electronic neural networks have been described 
by J. J. Hopf ield in "Neurons With Graded Response 
Have Collective Computational Properties Like 
Those of Two-state Neurons", Proc. Natl. Sci., USA 
Vol. 81, pp. 3088-3092; and by J.J. Hopf ield and D. 
W. Tank in "'Neural' Computation of Decisions in Op- 
timization Problems", Biological Cybernetics, Vol. 52, 
(1985), pp. 141-152; as well as in U. S. patent appli- 
cation Serial No. 693,479 filed on behalf of J. J. Hop- 
field on January 2, 1985; and U.S. patent application 
Serial No. 795,789 filed on behalf of J. J. Hopfield and 
D. W. Tank on November 7, 1985. 

Basically, the Hopfield neural network described 
in the above references is a highly parallel computa- 
tional circuit comprising a plurality of amplifiers, with 
each of the amplifiers feeding back its output signal 
to itself and all of the other amplifiers through conduc- 
tance T|j. The T|j conductances (where T u denotes the 
conductance between the output of amplifierjand the 
input of amplifier i) and the associated connections 
can be thought of as comprising a feedback network 
which has one output signal set and two input signal 
sets. The output signal set is applied to the amplifier 
inputs, one of the input signal sets is derived from the 
amplifier outputs, and the other input signal set is re- 
sponsive to input stimuli applied to the neural net- 
work. As shown in the prior art, one can explicitly 
specify the values of the Ty conductances to achieve 
predetermined results, such as reaching different 
specified output states of the amplifier in response to 
different ranges of input stimuli. Also as described in 
the prior art, an input interconnection network may be 
interposed between the input stimuli and the second 
set of inputs of the feedback network. The input inter- 
connection network permits manipulation of the ex- 
pected input signals to corresponding signals that 
drive the feedback network and the amplifiers. 

The neural network model described most exten- 
sively in the prior art is one with symmetric couplings, 
i.e., the connections between pairs of neurons satisfy 
the relationship T u =Tj|. The dynamics of such a net- 
work is relatively simple. The system moves in the di- 
rection of reducing a global energy function of the cir- 
cuit, E, to states that are local minima of E, and once 
a local minimum is reached, the circuit remains at the 
stable state until perturbed by a sufficiently large in- 
put signal that moves the circuit to a different local 
minimum. The local minima may be thought of as the 
stored "memories" that are characterized by the vec- 
tors M v . An associative memory can be constructed 
with the Hopfield neural network by constructing the 
connection strengths T y in accordance with the outer 
product, or Hebb, rule; to wit, by assiging 



T ij =iMrM J y 

v=l 

5 for j*i, and 0 otherwise. In a very simple embodiment 
T|j = -1 (an inhibitory connection) for i*j and 0 other- 
wise, resulting in a network that behaves as an n-flop; 
that is, a multi-output version of the well-known, two- 
output network commonly known as a flip-flop. 

w The Hopfield neural network is a very robust net- 
work, in the sense that it is able to associatively recall 
the stored memories even when the input is heavily 
distorted by noise, or when some of the hardware con- 
nections are inoperative. On the other hand, the Hop- 

15 field network must be sparsely populated with stored 
information, and some work has been done which in- 
dicates that the number of stored vectors in a Hopfield 
network should be limited to approximately 0.15N, 
where N is the number of amplifiers. Also, computa- 

20 tion of the T u values in the Hopfield network (for the 
general case) is not easy, and the precise location of 
the boundaries between regions of attraction of the 
memories is not easily controlled. 

According to this invention there is provided a 

25 network as claimed in claim 1 . 

Advantages of embodiments of the invention in- 
clude a network structure that allows for simple and 
efficient programming of the memories into the net- 
work, and an arrangement that can easily be imple- 

30 mented in integrated circuit technology. 

An associative computation network embodying 
the invention that is capable of storing K vectors of N 
bits each includes a decision network (e.g., a K-flop 
network) and a feedback arrangement that, f unction- 

35 ally, is separable into two serially connected net- 
works. The first network has its inputs connected to 
the outputs of the decision network and is arranged 
to develope K sets of excitatory and inhibitory drive 
signals. Each set corresponds to a stored vector and, 

40 more specifically, each "1" in the stored vector gives 
rise to an excitatory drive signal while each "0" gives 
rise to an inhibitory drive signal. For each different 
output state of the decision network, a different one 
of the K sets appears at the output of the first net- 

45 work. The output leads of the first network, which may 
also be employed as the input interface leads to the 
associative computation neural network, are con- 
nected to the second network. The second network 
develops K output signals thatare applied to inputs of 

so the decision network. The output signals of the sec- 
ond network are proportional to the projection of the 
input signals applied to the second network on the 
stored vectors. In one embodiment, the projection is 
obtained with connections in the second network that 

55 are excitatory when the applied input is excitatory and 
the corresponding component in the stored vector is 
a "1", and non-excitatory otherwise. This corre- 
sponds to an AND function of the inputs signals to the 



2 



3 



EP 0 276 068 B1 



4 



second network with the stored vectors. In another 
embodiment, the projection is obtained with an Exclu- 
sive NOR projection of the inputs signals to the sec- 
ond network with the stored vectors. In still another 
embodiment there is included another set of amplifi- 
ers that is interposed between the output of the first 
network and the input of the second network. A cor- 
relative application is also described. 

Brief Description of the Drawing 

FIG. 1 presents a schematic diagram of my asso- 
ciative computation network; 
FIG. 2 shows an efficient realization of the deci- 
sion network in FIG 1; 

FIGS. 3 and 4 illustrate one realization for imple- 
menting the C|j and C'ij connections of the FIG. 1 
networks; 

FIG. 5 depicts a physically rearranged structure 
of my FIG. 1 network that interleaves networks 
20 and 40 and thereby permits the use of a single 
memory cell for each bit in the set of stored vec- 
tors to control both networks;. 
FIG. 6 illustrates a different schematic diagram of 
my associative computation network; 
FIG. 7 presents a correlator application of my as- 
sociative computation network; and 
FIG. 8 illustrates the various storage arrange- 
ments and output ports of the FIG. 1 networkthat 
may be useful in different applications. 

Detailed Description 

FIG. 1 presents a diagram of one embodiment of 
the invention. It comprises a vector units network 10, 
a template projection network 20, a decision network 
30, and a template generator network 40; all intercon- 
nected in a feedback loop. A careful perusal of FIG. 
1 would reveal that the demarcation lines between 
the various above-named segregated units is largely 
arbitrary, but it is convenient to choose some borders 
so that a functional description of the circuit is made 
easier. Indeed, as shown infra, some of the segregat- 
ed units may be coalesced to form more compact re- 
alizations of my invention. 

Vector units network 10 in FIG. 1 serves as the 
gateway into which input signals are injected via lines 
12 and from which the output signals are derived via 
lines 15. More specifically, network 10 comprises N 
amplifiers 11, where N is the number of bits that each 
output vector is desired to have. I nput signals are fed 
into the inputs of amplifiers 11 , and the output signals 
of the FIG. 1 network are obtained from the output 
signals of amplifiers 11. In addition to contributing to 
the outputs of the FIG. 1 neural network, the outputs 
of amplifiers 11 are fed to template projection network 
20. Network 20 comprises N input leads and K output 
leads, where K is the number of stored "memories", 



or stable states, of the FIG. 1 network. These stable 
states form a set of the desired output vectors (each 
being N bits long). The input and output leads of net- 
work 20 form a grid, and thejunction points of the grid 
5 comprise interconnection nodes which, for conve- 
nience, are designated C u , where i marks the output 
lead and j marks the input lead of network 20. With 
this arrangement, the i» h output line of network 20 
drives the subsequent network (network 30) with a 
10 signal that is related to 

15 

where A is the output voltage of the j» h amplifier 11 . 

The collection of interconnection nodes for each 
of the K output leads of network 20 is related to a stor- 
ed vector. That is, each stored vector M| is defined by 

20 bitsMn.Me, ... My, ...M IN and is embodied, in a sense, 
in C M , C k , ... Cy, ... C !N . The correspondence between 
each Cy and My (i.e., the manner imparting the M,j in- 
formation to the connection) relates to the metric that 
is selected, as described in greater detail below. Ba- 

25 sically, however, the C,j connections develop a a 
measure of how closely the input signals reflect the 
expected output vector. Stated even more generally, 
any arrangement of C u is acceptable as jong as the 
output signals of network 20 provide a measure by 

30 which the projection of the input signals on the stored 
vectors can be ascertained. Typically, that means that 
the Cy connections are such that when network 10 re- 
sides at a state which corresponds to one of the stor- 
ed vectors, network 20 develops output signals where 

35 oneand only one of the output lines of network20 pro- 
vides a maximum drive to network 30. 

As an example of Cy connections, when the stor- 
ed vectors are such that no stored vector subsumes 
any other stored vector, then the Cy connections can 

40 be selected to be excitatory whe n the j th bit of the stor- 
ed vector is a "1" and non-excitatory when the j ,h bit 
of the stored vector is a "0". (An excitatory connection 
is one that tends to turn a subsequent amplifier "on", 
a non-excitatory connection is one that has no effect 

45 on a subsequent amplifier, and an inhibitory connec- 
tion is one that tends to turn a subsequent amplifier 
"off." Sometimes there is no practical difference be- 
tween a non-excitatory connection and an inhibitory 
connection.) Thus, with a set of stored vectors that do 

50 not subsume each other, the connections C|j can cor- 
respond to 

C g = AND(Vj,M,j), 
where AND stands for the logical AND function, and 
Vj takes on the logic value "1" when the j th amplifier 
55 11 is "on" and logic "0" otherwise. 

In applications where the above limitation on the 
stored vectors is not acceptable, the character of the 
connections can, for example, be selected to follow 
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the equation 

C u = EXNOR(Vj,M,j), 
where EXNOR is the logical Exclusive NOR function. 
Other metrics are, of course, also possible. 

It should be noted, perhaps, that the above two 
metrics are different from the one used in the prior art 
neural network feedback loop, where the algebraic 
product (Tyllj) is employed and where the Ty values 
are multiplicative constants. The above metrics, on 
the other hand, utilize logical relationships. It should 
not be viewed, however, that my invention is limited 
to logical relationships. To the contrary, the above ex- 
amples aim to show that the connections in my inven- 
tion can have algebraic, logical, or any other useful 
functional relation to the stored vectors. 

As indicated above, the output leads of template 
projection network 20 are connected to decision net- 
work 30. The function of network 30 is to respond to 
the projection signals developed by network 20 and 
develop therefrom the drive signals for network 40 
that would place network 10 in a state that corre- 
sponds to the one vector stored in network 40 that is 
closest to the input signals appearing at network 20. 

in many applications the function of network 30 
comes down to selecting the output line of network 20 
with the largest driving function and turning "on" a 
corresponding output line of network 30 while turning 
"off all other output lines of network 30. That is, in 
such applications the input to network 30 is a set of 
K signals/with one input signal (e.g., p ,h ) being the 
largest. The output of network 30 is also a set of K sig- 
nals, E 1 , E 2 , ... E K , with one output signal (e.g., E p ) 
being high, or "on," and all other output signals being 
"off. This mutually inhibiting type of network 30 is 
achieved in the FIG. 1 network with a simple K-flop 
Hopfield network (described above) of K amplifiers 
31 and a local feedback network 32, where the Ty con- 
nection coefficients in feedback network 32 follow 
the relationship T u = -1 when i * j and 0 otherwise. A 
different realization of a K-flop network is shown in 
FIG. 2 and described below. 

The K-flop realization for network 30 is the sim- 
plest, but it certainly is not the only one. For example, 
a "largest" projection signal at the input to network 30 
may be designed to turn "on" more than one output 
line of network 30, or designed to induce different 
analog signals at the outputs of network 30. 

Turning attention again to FIG. 1, the output sig- 
nals Of network 30 are applied to template generator 
network 40. Structurally similar to network 20, tem- 
plate generator network 40 has K input leads and N 
output leads that internally form a grid. The junction 
points of the grid comprise interconnection nodes 
which, for convenience, are designated Cy, where i 
marks the i th input lead and j marks the j th output lead 
of network 40. Since network 40 is the template gen- 
erator network, in applications where network 30 is a 
K-flop the connectivity is C',j = My, where C'|j=1 cor- 



responds to an excitatory connection, and C'|j=0 cor- 
responds to an inhibitory connection. The output 
leads of network 40 are connected to the inputs of 
vector units network 10, and in this manner network 

5 40 strives to maintain network 1 0 at a state that cor- 
responds to one of the stored vectors. 

Although a specific interconnection approach is 
described above for network 40 (C'u ), it should be re- 
alized that any drive approach will do as long as the 

to input lines to network 40 cause the delivery of a set 
of drive signals that tend to place network 1 0 at a state 
that corresponds to a stored vector. Of course, a K- 
flop input to network 40 does result in a very simple 
correspondence between the stored vectors and the 

15 C'u connections. 

To assist in moving the network of FIG. 1 to a dif- 
ferent state, network 30 includes a control lead 33 
that turns "off all of the amplifiers in network 30. 
When control 33 is activated, amplifiers 33 develop 

20 no output voltage, and that condition disables the in- 
hibitory action of network 32 and the driving action of 
network 40 (driving the amplifiers of network 10). In^ 
put lines 12 are then employed to apply an appropri- 
ate voltage to each amplifier 11, placing network 10 

25 in a different state. In accordance with the above de- 
scribed operation of network 20, the new state of net- 
work 10 develops a set of template projections onto 
the output lines of network 20. The output line of net- 
work 20 whose C,j connections correspond to a stored 

30 vector that is closest (by the metric chosen) to the 
newly forced state of network 1 0 is now the one that 
injects the maximum current into network 30. As con- 
trol 33 is deactivated, the input line with the largest in- 
jecting current is the first one to turn its correspond- 

35 ing amplifier "on", and that amplifier inhibits all other 
amplifiers via network 32 in accordance with the K- 
flop action of network 30. The output line of network 
30 that is turned "on" causes template generator net- 
work 40 to appropriately apply excitatory and inhibi- 

40 tory signals to the various amplifiers in network 10, 
placing the network into the quiescent state corre- 
sponding to the vector that matches most closely (has 
largest projection value in accordance the metric 
chosen for network 20) to the state to which network 

45 10 was initially placed by the applied input 

FIG. 2 presents an efficient realization of the K- 
flop decision network 30. In FIG. 2, amplifiers 31 are 
implemented in the form of three-input AND gates, 
where the output of each AND gate 31 is connected 

so to a serial connection Of two complementary MOS 
switches 34 and 35 that are connected between one 
of the AND gate inputs and ground. A second input of 
all AND gates 31 is connected to control line 33, and 
the remaining inputs of AND gates 31 form the inputs 

55 . to network 30. Switches 34 and 35 in FIG. 2 are a p- 
channel switch 34 and an n-channel switch 35. Switch 
34, connected to the AND gate's input, is open when 
its control voltage is high and closed when its control 
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voltage is low. Conversely, gate 35 is closed when its 
control voltage is high and open when its control vol- 
tage is low. The junction points of the complementary 
switches are all connected to a source V DD via inhibit 
line 36 and a resistor. In operation, a low voltage on 
control lead 33 disables gates 31. Consequently, 
switches 34 are closed, switches 35 are open, and 
line 36 is high. As soon as control lead 33 goes high, 
gates 31 begin to turn "on" under the influence of the 
drive signals applied to network 30. The gate with the 
largest drive signal turns "on" first, and it reverses the 
states of the switches connected to it. The associated 
switch 35 drives line 36 to a low state and, through 
closed switches 34, the low level on line 36 causes all 
gates 31 to turn "off; except the gate that turned "on" 
first, (because its associated switch 34 was opened 
by the turned "on" gate 31). 

The C|j and C'y connections of networks 20 and 
40 can be implemented by physically affixing the My 
bits of the stored vectors within the circuitry that re- 
alizes the C|j and C' u connections within networks 20 
and 40. It makes for a more versatile circuit, however, 
when the My bits can be stored in networks 20 and 40 
in an alterable way, such as within accessible mem- 
ory cells. 

FIG. 3 depicts one embodiment for developing 
the C|j connections of network 20 through the use of 
memory cells. Line 15 is an input line of network 20 
and line 21 is an output line of network 20. Block 22 
is a cell, e.g., a flip-flop, which holds the value of My. 
To obtain the EXNOR connectivity described above, 
the requiredjogical function that must be developed 
is Vj-Mij + Vj Mij. This logical function is realized in FIG. 
3 with the arrangement' of transistors 23, 24, 25 and 
26. Transistor 24 is turned "on" by a true value on line 
15 while transistor 23 is turned "on" by a true value 
at the output of cell 22. Transistors 23 and 24 are con- 
nected in serial fashion and interposed between a vol- 
tage source V DD (to which resistor 27 is connected) 
and line 21. In parallel with the serial connection of 
transistors 23 and 24 is a serial connection of transis- 
tors 25 and 26. Transistors 25 and 26 are turned "on" 
by a false value at the output of cell 22 and on line 15, 
respectively. 

FIG. 4 depicts one embodiment for developing 
the C'u connections of network 40. Line 12 is an out- 
put line of network 40 and line 41 is an input line of 
network 40. As in FIG. 3, block 22 is a cell which holds 
the value of Mij, and that value is communicated to line 
12 via transistor switch 43, under control of line 41. 

Recognizing that Cy and C'y are both controlled 
by cells 22 in the above-described embodiments, it is 
clear that VLSI implementation advantages can be 
had by combining networks 20 and 40. FIG. 5 illus- 
trates one way for interleaving the input and output 
lines of networks 20 and 40 so that any cell 22 can 
easily control the necessary current flow. The input 
and output lines of amplifiers 11 form columns in FIG. 



5, and the input and output lines of amplifiers 31 form 
rows in FIG. 5. The nodes where output column lines 
and input row lines intersect contain the Cy connec- 
tions, and the nodes where output row lines and input 

5 column lines intersect contain the C'u connections. 
For sake of clarity, FIG. 5 includes a blow-up of a por- 
tion in FIG. 5 that encompasses both a C and a C 
connection, illustrating the fact that a single M u cell 
controls both connections. 

10 Although the connections to, and from, cells 22 
. are not shown in FIG. 5, it is easy to appreciate that 
the various cells storing the M u bits in the structure of 
FIG. 5 can be interconnected in a serial, shift register, 
fashion to permit loading of the My values of the vec- 

15 tors to be stored from 1 , N, or K ports, as desired; or 
arranged to be addressed as a conventional RAM. 

The arrangement of FIG. 1 includes amplifier net- 
work 1 0, which provides regeneration and a degree of 
isolation between the shown input and output ports. 

20 In some applications, however, it may be desirable to 
do without amplifiers 11. This can be accomplished 
by replacing the current drive supplied by C'y with a 
corresponding voltage drive (low source impedance) 
that is applied directly to network 20. This is tanta- 

25 mount to a collapsing of the column pairs in the FIG. 
4 illustration, which leads to the drawing of FIG. 6. 
Thus, FIG. 6 includes a K-flop neural network 30 and 
an input interconnection network 50 having one out- 
put port of K leads which applies signals to network 

30 30, one input port of K leads which receives signals 
from network 30, and one input/output port of Nleads 
which serves as an interface to the FIG. 6 network. 
As in FIG. 1 , K is the number of stored vectors and N 
is the number of bits per vector. In accordance with 

35 the above, each output Ej of network 30 contributes 
with a current drive to the i th amplifier 31 via a con- 
nection 

D,j = EXNOR(AND(E|,My),M|j). 
One embodiment of this logical interconnection ar- 
40 rangement is depicted in the blow-up portion of FIG. 
6. 

FIG. 7 presents an interesting application of my 
neural network. 

Often it is desirable to perform a cross- 
45 correlation computation (or an auto-correlation com- 
putation) on an incoming signal. A cross-correlation 
can be performed, for example, by sampling the sig- 
nal against which the cross-correlation of an inputsig- 
nal is to be evaluated, to develop a vector M (compris- 
50 ing N bits) and storing vector M as one of the vectors 
in networks 20 and 40. Shifted replicas of M are then 
stored as the other vectors of networks 20 and 40. 
This arrangement is shown in FIG. 7, wherein register 
60 is loaded with a reference signal M and the differ- 
.55 . ent components of Mare loaded into the various cells 
22 of FIG. 7 in a staggered fashion to effect the afore- 
described storing of delayed replicas of M. This is 
shown diagrammatically in FIG. 7 by dashed lines 51 , 
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52 and 53. In operation, an input signal is applied at 
the input/output port of the FIG. 7 network, yielding 
shortly thereafter an output vector at the input/output 
port that is closest to the applied signal. The input and 
output ports of network 30 give a different and, per- 5 
haps, a more useful indication in a correlator applica- 
tion. The output port of network 30 delivers a vector 
with one component being high, or "1", and the other 
components being low. The component that is high 
identifies the particular delayed replica of M that best 10 
correlates with the input signal. The input port to net- 
work 30 provides the actual correlation values. 

Although a number of embodiments have been 
disclosed herein, still different embodiments and ap- 
plications will, no doubt, suggest themselves to those 15 
who are skilled in art to which this invention pertains. 

For example, the above descriptions do not spe- 
cifically state that the voltages developed by amplifi- 
ers 11 and 31 can be any alterable analog values, but 
such a realization falls squarely within the invention. 20 

In still another example, the concept of using an 
output other than the output of projection network 20 
(in FIG. 1) may be expanded. To illustrate, the output 
signals of network 30 are as indicative of the selected 
memory as are the outputs of network 20 and the 25 
drive signals of network 40. When network 30 is a K- 
f lop, the output of network 30 is very simple (a "1 " in 
the p th output lead means that the p lh vector was se- 
lected) and that output can be employed, in encoded 
or in unencoded form, as the output of the network. 30 
Thus, the output of the FIG. 1 network can be derived 
as shown in FIG. 8, by encoding the outputs of net- 
work 30 with encoder 70, loading the encoded output 
into shift register 80 and extracting the output signals 
of the FIG- 8 network from the serial output of register 35 
80. This, of course, reduces the number of leads re- 
quired to interface with the FIG. 8 network. A network 
30 that is other than the K-flop can, perhaps, do even 
without encoder 70. 

Also shown in FIG. 8 is a network 40 which em- 40 
ploys the drive signals to network 10, plus some ad- 
ditional output leads from an auxiliary network 41 , as 
the output signals of the FIG. 8 network. This permits 
the FIG. 8 network to operate more than justa content 
addressable memory which outputs the closest repli- 45 
caof its input. The additional outputs from network41 
can provide whatever additional information it is de- 
sired to be stored for each vector. Network 41 is driv- 
en by the output signals of network 30. 



Claims 

1. An associative network for storing K vectors M h 

where i is an index in the range 1 to K and desig- 55 
nates a particular vector, and each vector M, has 
components My where j is an index in the range 
1 to N and designates the component number of 



the vector, K and N being integers, comprising: 

a decision network (30) for developing at 
K output ports (ED of said decision network sig- 
nals that indicate recognition of a degree of pres- 
ence of said vectors within input signals appear- 
ing at K input ports of said decision network; and 
an interconnection network (40, 10, 20) 
having K input leads connected to said K output 
ports and K output leads connected to said K in- 
put ports, and N network interface leads (12), 
where each of said network interface leads, j, is 
coupled to each output lead, i, of said intercon- 
nection network through a connection C w and to 
each input lead, k, of said interconnection net- 
work through a connection C' y , 

C/y being defined as a logic function of v} 
and My, where v} is a signal on a/ ft lead of said 
network interface leads (1 2), and C' w being de- 
fined as a logic function of E k and M w , where E k 
is a kf h output of said decision network (30), 

2. A network as claimed in claim 1 wherein said Cy 
connections develop signals at said K input ports 
of said decision network (30) that are related to 
the projections of signals on said network inter- 
face leads (12) on said K vectors. 

3. A network as claimed in claim 1 wherein each set 
of said dj connections for a selected value of j de- 
velop a signal at a I th output lead of said intercon- 
nection network (40, 10, 20) that is related to the 
projection of signals on said network interface 
leads ( 1 2) on one of sa id K vectors. 

4. A network as claimed in claim 1 where said C' s 
connections develop signals for driving said inter- 
connection network (40, 10, 20) to a state where 
signals on said network interface leads corre- 
spond to one of said K vectors. 

5. A network as claimed in claim 1 wherein said de- 
cision network (30) is a K-flop network and each 
set of said C, connections for a given subscript j 
is related to one of said K vectors. 

6. A network as claimed in claim 5 wherein each set 
of said C,j connections develops signals at said K 
input ports of said K-flop network (30) that are re- 
lated to the projections of said signals at said net- 
work interface leads (12) on said K vectors. 

7. A network as claimed in claim 5 wherein each 
vector MyOf said K vectors comprises bits My, and 
each of said C' f forms an excitatory connection 
when My = 1 and an inhibitory connection when 
M,j=Q. 

8. A network as claimed in claim 5 wherein each 
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vector My of said K vectors comprises bits M ff and 
wherein C ;y = AND(v},Afy), where Vj is a signal on 
a./ ft lead of said network interface leads (12). 

9. A network as claimed in claim 5 wherein each 
vector My of said K vectors comprises bit My and 
wherein C (/ = EXNOR( Vj.My), where Vj is a signal 
on a J"" lead of said network interface leads (1 2). 

10. A network as claimed in claim 5 wherein each 
vector My of said K vectors comprises bits M y , and 
where C', y = AND (E y ,M ff ), where Ey is a/" output 
of said K-f lop network (30). 

11. A network as claimed in claim 5 comprising am- 
plifiers interposed between said interconnection 
network N input leads and said interconnection 
network (40, 10, 20) N vector output leads. 

12. A network as claimed in claim 1 comprising con- 
trol means (control 33) connected to said deci- 
sion network (30) for disabling all output signals 
at said K output ports. 

13. A network as claimed in claim 1, adapted to de- 
velop output signals responsive to signals ap- 
pearing at said K output ports of said decision 
network (30). 

14. A network as claimed in claim 1 comprising a net- 
work output port and shift register means (60) in- 
terposed between said network output port and 
said K output ports of said decision network (30). 

1 5. A network as claimed in claim 1 comprising a net- 
work output port and decoder means (70) inter- 
posed between said network output port and said 
K output ports of said decision network (30). 

16. A network as claimed in claim 1 comprising an 
auxiliary network (41), responsive to said K out- 
put ports of said decision network, for developing 
signals for additional output leads of said net- 
work. 



Patentanspruche 

1. Assoziatives Netzwerk zur Speicherung von K 
Vektoren M,, wobei i ein Index im Bereich zwi- 
schen 1 bis K ist und einen bestimmten Vektor be- 
zeichnet, jeder Vektor M, Komponenten My be- 
sitzt, j ein Index im Bereich von 1 bis N ist und die 
Komponentennummer des Vektors bezeichnet 
und K und N ganze Zahlen sind, mit: 
einem Entscheidungsnetzwerk (30) zur Erzeu- 
gung an K Ausgangsports (E,) des Entschei- 
dungsnetzwerks Signale, die die Erkennung ei- 



nes Wahrscheinlichkeitsgrades fur das Vorhan- 
densein der Vektoren in Eingangssignalen anzei- 
gen, welche an K Eingangsports des Entschei- 
dungsnetzwerks erscheinen, und 

5 einem Verbindungsnetzwerk (40,10,20) mit K, 

mit den K Ausgangsports verbundenen Ein- 
gangsleitungen, K, mit den K Eingangsports ver- 
bundenen Ausgangsleiturigen und N Netzwerk- 
Schnittstellenleitungen (12), wobei jede Netz- 

10 werk-Schnittstellenleitung j mit jeder Ausgangs- 
leitung i des Verbindungsnetzwerks iiber eine 
Verbindung C kJ und jeder Eingangsleitung k des 
Verbindungsnetzwerks iiber eine Verbindung C' kJ 
verbunden ist, 

15 wobei C|j als logische Funktion von Vj und My de- 

f iniert ist, Vj ein Signal auf einer j-ten Leitung der 
Netzwerk-Schnittstellenleitungen (12) ist, und 
C' k j als logische Funktion von E k und M kJ def iniert 
ist, und E k der k-te Ausgang des Entscheidungs- 

20 netzwerks (30) ist. 

2. Netzwerk nach Anspruch 1, bei dem C,j Verbin- 
dungen Signale an den K Eingangsports des Ent- 
scheidungsnetzwerks (30) erzeugen, die zu den 

25 Projektionen von Signalen auf den Netzwerk- 
Schnittstellenleitungen (12) auf die K Vektoren in 
Beziehung stehen. 

3. Netzwerk nach Anspruch 1 , bei dem jeder Satz 
30 von C|j Verbindungen fur einen gewahlten Wert 

von j ein Signal auf einer i-ten Ausgangsleitung 
des Verbindungsnetzwerks (40,10,20) erzeugt, 
das zu der Projektion von Signalen auf den Netz- 
werk-Schnittstellenleitungen(12)auf einen derK 
35 Vektoren in Beziehung steht. 

4. Netzwerk nach Anspruch 1 , bei dem die C'y Ver- 
bindungen Signale erzeugen, die das Verbin- 
dungsnetzwerk (40,10,20) in einen Zustand trei- 

40 ben, in welchem Signale auf den Netzwerk- 

Schnittstellenleitungen einem der K Vektoren 
entsprechen. 

5. Netzwerk nach Anspruch 1, bei dem das Ent- 
45 scheidungsnetzwerk (30) ein K-Flop-Netzwerk 

ist und jeder Satz der C, Verbindungen fur einen 
gegebenen Index j in Beziehung zu einem der K 
Vektoren steht. 

so 6. Netzwerk nach Anspruch 5, bei dem jeder Satz 
der C u Verbindungen Signale auf den K Eingang- 
sports des K-Flop-Netzwerks (30) erzeugt, die 
zu den Projektionen der Signale an den Netz- 
werk-Schnittstellenleitungen (12) auf die KVek- 

55 toren in Beziehung stehen. 

7. Netzwerk nach Anspruch 5, bei dem jeder Vektor 
Mj der K Vektoren Bits My urnfa&t und jede der C'u 
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Verbindungen eine Erregungsverbindung bildet, 
wenn M,j = 1 ist eine Sperrverbindung, wenn M,j 
= 0 ist. 

8. Netzwerk nach Anspruch 5, bei dem jeder Vektor 
Mj der K Vektoren Bits M u umfaBt und C, = UND 
(Vj, My) ist, wobei Vj ein Signal auf einerj-ten Lei- 
tung der Netzwerk-Schnittstellenleitungen (12) 
ist. 

9. Netzwerk nach Anspruch 5, bei dem jeder Vektor 
Mj der K Vektoren Bits M u umfaBt und C a = 
EXNOR (Vj, M,j) ist, wobei Vj ein Signal auf einer 
j-ten Leitung der Netzwerk-Schnittstellenleitun- 
gen (12) ist. 

10. Netzwerk nach Anspruch 5, wobei jeder Vektor Mj 
der K Vektoren Bits M„ umfaBt und C'ij = UND (Ej, 
M|j) ist, wobei Ej ein j-ter Ausgang des K-Flop- 
Netzwerks (30). 

11. Netzwerk nach Anspruch 5, mit Verstarkern, die 
zwischen die N Eingangsleitungen des Verbin- 
dungsnetzwerks und die N Vektorausgangslei- 
tungen des Verbindungsnetzwerks (40,10,20) 
geschaltet sind. 

12. Netzwerk nach Anspruch 1, mit einer Steuerein- 
richtung (Steuerung 33), die mit dem Entschei- 
dungsnetzwerk (30) verbunden ist, urn alle Aus- 
gangssignale an den K Ausgangsports abzu- 
schalten. 

13. Netzwerk nach Anspruch 1 , das Ausgangssigna- 
le unter Ansprechen auf Signale erzeugt, die an 
den K Ausgangsports des Entscheidungsnetz- 
werks (30) erscheinen. 

14. Netzwerk nach Anspruch 1, mit einer 
Netzwerkausgangsport- und Schieberegisterein- 
richtung (60), die zwischen die Netzwerk-Aus- 
gangsports und die K Ausgangsports des Ent- 
scheidungsnetzwerks (30) eingefugt ist. 

15. Netzwerk nach Anspruch 1, mit einer 
Netzwerkausgangsport- und Decodiereinrichtung 
(70), die zwischen die Netzwerkausgangsports 
und die K Ausgangsports des Entscheidungs- 
netzwerks (30) eingefugt ist. 

16. Netzwerk nach Anspruch 1, mit einem Hilfsnetz- 
werk (41), das unter Ansprechen auf die K 
Ausgangsports des Entscheidungsnetzwerks Si- 
gnale fur zusatzliche Ausgangsleitungen des 

, Netzwerks erzeugt. 



Revendications 

1. Un reseau associatif pour enregistrer K vecteurs 
M h dans lesquels i est un index dans la plage de 
5 1 a K et designe un vecteur particulier, et chaque 

vecteur M| a des composantes Mq dans lesquelles 
j est un index dans la plage de 1 a N et designe 
le numero de composante du vecteur, K et N etant 
des nombres entiers, comprenant : 
w un reseau de decision (30) pour produire 

sur K acces de sortie (E,) de ce reseau de deci- 
sion des signaux qui indiquent la reconnaissance 
d'un degre de presence des vecteurs precites 
dans des signaux d'entree apparaissant sur K ac- 
ts ces d'entree du reseau de decision; et 

un reseau d'interconnexion (40, 10, 20) 
ayant K conducteurs d'entree connectes aux K 
acces de sortie et K conducteurs de sortie 
connectes aux K acces d'entree, et N conduc- 
20 teurs d'interface de reseau (12), chacun de ces 
conducteurs d'interface de reseau, j, etant 
connecte a chaque conducteurde sortie,, i, du re- 
seau d'interconnexion par I'intermediaire d'une 
connexion C kJ eta chaque conducteur d'entree, k, 
25 du reseau d'interconnexion par I'intermediaire 
d'une connexion C' kJ , 

C|j etant definie comme une fonction logi- 
que de Vj et M| Jt en designant par Vj un signal sur 
un j-ieme conducteur parmi les conducteurs d'in- 
30 terface de reseau (12), et C' kJ etant definie 
comme une fonction logique de E k et My, en de- 
signant par E k une k-ieme sortie du reseau de de- 
cision (30). 

35 2. Un reseau selon la revendication 1, dans lequel 
les connexions C pj produisent sur les K acces 
d'entree du reseau de decision (3D) des signaux 
qui sont lies aux projections, sur les K vecteurs, 
de signaux presents sur les conducteurs d'inten- 

40 face de reseau (12). 

3. Un reseau selon la revendication 1, dans lequel 
chaque ensemble des connexions C,j pour une 
valeur selectionnee de j produit un signal sur un 
45 i-ieme conducteur de sortie du reseau d'intercon- 
nexion (40, 10, 20) qui est lie a la projection, sur 
I'un des K vecteurs, de signaux presents sur les 
conducteurs d'interface de reseau (12). 

so 4. Un reseau selon la revendication 1, dans lequel 
les connexions C' ( produisent des signaux pour 
attaquer le reseau d'interconnexion (40, 10, 20), 
pour le faire passer dans un etat dans lequel des 
signaux presents sur les conducteurs d'interface 

55 de reseau correspondent a I'un des K vecteurs. 

5. Un reseau selon la revendication 1, dans lequel 
le reseau de decision (30) est un reseau de bas- 
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cule d'ordre K, et chaque ensemble de 
connexions C'| pour un indice j donne est lie a I'un 
des K vecteurs. 

6. Un reseau selon la revendication 5, dans lequel 
chaque ensemble de connexions C,j produit des 
signaux sur les K acces d'entree du reseau de 
bascule d'ordre K (30) qui sont lies aux projec- 
tions, sur les K vecteurs, des signaux presents 
sur les conducteurs d'interface de reseau (12). 

7. Un reseau selon la revendication 5, dans lequel 
chaque vecteur Mj parmi les K vecteurs 
comprend des bits My, et chacune des C'y forme 
une connexion. d'excitation lorsque My = 1 et une 
connexion d'inhibition lorsque My = 0. 

8. Un reseau selon la revendication 5, dans lequel 
chaque vecteur Mj parmi les K vecteurs 
comprend des bits My, et dans lequel C,, = 
ET(Vj,M|j), en designant par Vj un signal sur un j- 
ieme conducteur parmi les conducteurs d'interfa- 
ce de reseau (12). 

9. Un reseau selon la revendication 5, dans lequel 
chaque vecteur Mj parmi les K vecteurs 
comprend des bits My, et dans lequel Cy = NON- 
OU-EXO/j.My), en designant par Vj un signal sur 
un j-ieme conducteur parmi les conducteurs d'in- 
terface de reseau (12). 

10. Un reseau selon la revendication 5, dans lequel 
chaque vecteur M, parmi les K vecteurs 
comprend des bits My, et dans lequel C'y = 
ET(Ej,My), en designant par Ej une j-ieme sortie 
du reseau de bascule d'ordre K (30). 

11. Un reseau selon la revendication 5, comprenant 
des amplificateurs interposes entre les N 
conducteurs d'entree du reseau d'interconnexion 
et les N conducteurs de sortie de vecteur du re- 
seau d'interconnexion (40, 10, 20). 



reseau de decision (30). 

15. Un reseau selon la revendication 1, comprenant 
un acces de sortie de reseau et des moyens de- 

5 codeurs (70) intercales entre cet acces de sortie 

de reseau et K acces de sortie du reseau de de- 
cision (30). 

16. Un reseau selon la revendication 1, comprenant 
10 unreseauauxiliaire(41),fonctionnantsouslade- 

pendance des K acces de sortie du reseau de de- 
cision, pour produire des signaux pour des 
conducteurs de sortie supplementaires du re- 
seau. 

15 



20 



30 



35 



12. Un reseau selon la revendication 1, comprenant 

des moyens de commande (conducteur de 45 
commande 33) connectes au reseau de decision 
(30) pour invalider tous les signaux de sortie sur 
les K acces de sortie. 



13. Un reseau selon la revendication 1, concu pour so 
produire des signaux de sortie sous la dependen- 
ce de signaux qui apparaissent sur K acces de 
sortie du reseau de decision (30). 

14. Un reseau selon la revendication 1, comprenant 55 
un acces de sortie de reseau et une structure de 
registre a decalage (60) intercalee entre cet ac- 
ces de sortie de reseau et K acces de sortie du 
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